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CONTROL SYSTEM 

BACKGROUND OF THE INVENTION 
The present invention relates to a control system 
5 for executing control of displaying an image and 

reproducing a piece of music corresponding to a sound such 
as an ambient sound, and so on. 

There has hitherto been a case of desiring to know, 
when talking by a mobile phone, an ambient condition of 
10 a speaker as the other party such as detecting whether 
the other speaker might feel embarrassed talking as in 
a train, a library etc. 

There is, however, little ambient information 
conveyed from a voice , and it is difficult to exactly grasp 
15 the ambient condition. 

Further, in the case of giving a call through IP 
(Internet Protocol) telephony and performing a voice chat 
between personal computers , an arbitrary image and a music 
file are transmitted to the other party for the 
20 communications. This scheme is, however, no more than 
transmitting the data specified by the user each time, 
and is incapable of obj ectively judging the user ' s ambient 
condition . 

25 SUMMARY OF THE INVENTION 

It is a primary object of the present invention, 
which was devised in view of the problems inherent in the 
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prior art, to provide a function capable of executing 
control of displaying an image and reproducing a piece 
of music corresponding to a received sound. 

To accomplish the above object, according to one 
5 aspect of the present invention , a control system includes 
a sound input unit receiving an input of a voice, an 
analyzing unit obtaining a characteristic of the sound 
received by the sound input unit, by analyzing the sound, 
a control information storage unit by storing therein a 

10 control information corresponding to the characteristic 
of the sound , a retrieving unit retrieving from the control 
information storage unit, the control information 
corresponding to the characteristic of the sound , an output 
unit outputting a predetermined effect , and a control unit 

15 controlling the output unit based on the control 
information retrieved by the retrieving unit. 

The predetermined effect may be at least one of 
operations performed based on predetermined functions 
such as displaying an image, reproducing a piece of music 

20 and giving a notice by vibrations . 

The characteristic of the sound may be a power 
spectrum . 

The control system according to the present 
invention may further include a specif ying unit specifying, 
25 when the sound input unit receives a sound for a speech, 
an ambient sound contained in the received sound, and 
wherein the retrieving unit may retrieve out the control 
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information corresponding to the ambient sound specified 
by the specifying unit. 

The control system according to the present 
invention may further include a detection unit detecting 
5 an auxiliary information to be used for the retrieve, and 
wherein the control information storage unit may be stores 
therein the sound characteristic, the auxiliary 
information and the control information in a way that 
corresponds the sound characteristic and the auxiliary 

10 information to the control information , and the retrieving 
unit may be retrieves from the control information storage 
unit, the control information corresponding to the sound 
characteristic and the auxiliary information. 

Note that the auxiliary information is defined as 

15 a time, a position, brightness and so on. 

The control system according to the present 
invention may further include a speaking state detection 
unit detecting, when the sound input unit receives the 
sound for a speech, a speaking period and a non-speaking 

20 period. 

According to another aspect of the present invention , 
a storage medium readable by a machine , tangible embodying 
a program of instructions executable by the machine to 
perform method steps comprising, obtaining a 
25 characteristic of an inputted soundby analyzing the sound, 
retrieving from a control information storage unit, a 
control information corresponding to the characteristic 
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of the sound, and executing the control so as to output 
a predetermined effect on the basis of the retrieved 
control information . 

Herein, the readable-by-computer storage medium 
5 includes storage mediums capable of storing information 
such as data, programs, etc. electrically, magnetically, 
optically and mechanically or by chemical action, which 
can be all read by the computer. What is demountable out 
of the computer among those storage mediums may be, e.g. , 
10 a flexible disk, a magneto-optic disk, a CD-ROM, a CD-R/W, 
a DVD, a DAT, an 8mm tape, a memory card, etc. 

Further, a hard disk, a ROM (Read Only Memory) and 
so on are classified as fixed type storage mediums within 
the computer. 

15 With the architecture described above, according 

to the present invention, a grasp of an ambient condition 
of even what is hard to recognize simply by hearing a sound 
can be facilitated by displaying a specific image an 
reproducing a piece of music. 

20 Moreover, according to the present invention, when 

applied to a field of, e.g., entertainment, a picture 
suited to the ambient condition canbe appeared interesting 
on the basis of the received sound. 

Note that the sound according to the present 

25 invention is defined as a sound representing the ambient 
condition such as a human voice, TV and radio sounds, 
voices (crying) of animals, a traveling sound of a train, 
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a sound of a siren and so forth. Further, the sound is 
not limited to an audible frequency band and may include 
sounds having frequency bands receivable by a sound input 
unit such as a high frequency contained in a sound of a 
5 car engine, and a low frequency of a haul of wind. 

Further, according to the present invention, the 
ambient sound is a sound emitted from the environment where 
the voice is inputted, and includes naturally hearable 
sounds irrespective of whether to be aware of or not, such 
10 as chatting voices around, exhaust noises of vehicles 
coming and going, chirping of insects in tranquility in 
the night, typing sounds of keys of the personal computer 
in the office, and so on. 

15 BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other features and advantages, of 
the present invention will become more readily appreciated 
as the same becomes better understood by reference to the 
following detailed description when taken in conjunction 
20 with the accompanying drawings wherein: 

FIG . 1 is a conceptual diagram showing a mobile phone 
as a control system in an embodiment 1 ; 

FIG. 2 is a block diagram showing a mobile phone 
3 of the present invention; 
25 FIG. 3 is an explanatory diagram showing a power 

spectrum; 

FIG. 4 is an explanatory diagram showing a table 
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stored with power spectrums and pieces of control 
information ; 

FIG. 5 is an explanatory diagram showing a control 
procedure for displaying an image corresponding a voice; 
5 FIG. 6 is an explanatory diagram showing related 

images representing a high traffic density ; 

FIG. 7 is a block diagram showing a case of using 
a computer ; 

FIG. 8 is an explanatory diagram showing an example 
10 of providing an ambient sound specifying unit; 

FIG. 9 is a diagram showing an example of 
simultaneously displaying a condition of a speaker as the 
other party and a condition of a speaker himself or herself ; 

FIG. 10 is a schematic diagram showing the mobile 
15 phone 3 in an embodiment 2 ; and 

FIG. 11 is an explanatory diagram showing a table 
stored with power spectrums and pieces of auxiliary 
information in a way that maps them to each other. 

20 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

<Embodiment 1> 

A mobile phone as a control system according to an 
embodiment 1 of the present invention will hereinafter 
be described with reference to FIGS. 1 through 9. 
25 §1 . Whole Architecture 

FIG. 1 is a conceptual view showing the mobile phone 
as the control system in the embodiment 1. 
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At first, a sound input unit receives a voice, and 
next an analyzing unit acquires a. power spectrum of the 
received voice. The voice herein is defined as a sound 
according to the present invention, and includes a voice 
5 of a speaker , an ambient sound emitted from the environment 
and other general sounds. Then, a retrieving unit 
compares the power spectrum with existing power spectrums 
stored in a control information storage unit, and judges 
from a similarity r a sound volume in a specified frequency 

10 band etc whether or not the target power spectrum matches 
with one of the existing power spectrums . The retrieving 
unit retrieves control information corresponding to the 
power spectrum judged to be matched . Then , a control unit , 
based on this item of control information, controls an 

15 output unit such as displaying a predetermined image on 
an image display device (display unit) , reproducing amusic 
and a message, and so on. 

The mobile phone in the embodiment 1 is thus 
constructed so as to be capable of expressing an ambient 

20 state hard to recognize only through the voice by the image 
and by music , and of thus facilitating a grasp of the state 
of where the user himself or herself or the speaker as 
the other party exists . 

§2. Architecture of Mobile Phone 

25 Next, respective components configuring the mobile 

phone in the embodiment 1 will be explained. 

FIG. 2 is a block diagram showing a mobile phone 
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3 according to the present invention. 

The mobile phone 3 in the embodiment 1 includes an 
antenna 31 for transmitting and receiving radio waves for 
performing communications with a radio base station 
5 (unillustrated) , a radio UNIT 32 for generating receipt 
data by demodulating the radio waves received by the 
antenna 31, and outputting modulation signals to the 
antenna 31 in a way that modulates transmission data into 
a predetermined frequency, a control UNIT (control unit) 

10 33 for executing control such as decoding the demodulation 
signals generated by the radio UNIT 32 and enabling the 
communications by outputting the encoded transmission 
data to the radio UNIT 32 , and a display unit 34 , constructed 
of , e.g., an LCD (Light Emitting Diode) , for displaying 

15 the information under the control of the control unit 33 . 

The mobile phone 3 further includes a storage unit 
(control information storage unit) 35 stored with 
telephone number data, an application program and pieces 
of control information corresponded the power spectrums 

20 of the voices that will be described later on, a key 
operation unit 36.. The mobile phone 3 still further 
includes a call notifying UNIT 37 for notifying the user 
of a call by a music and vibrations, a voice codec (sound 
input unit) 38 for receiving the voice data decoded by 

25 the control UNIT 33, decoding the voice data in 

specifications of a voice encoding system, thereafter 
executing an analog conversion thereof, outputting the 
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voice data as voice signals to the voice output unit 39, 
then encoding, after converting the inputted voice signals 
into digital signals, the same signals into voice data 
in the specifications of the voice encoding system, and 
5 outputting the voice data to the control UNIT 33 . The 
mobile phone 3 yet further includes a voice output unit 
39, constructed of a loudspeaker and an amplifier, for 
outputting the voice signals, and an input unit 40 
constructed of, e.g., a microphone. 

10 Moreover, the mobile phone 3 has an ANALYZING UNIT 

(analyzing circuit) 41 for obtaining the voice signals 
outputted from the voice codec via the control UNIT 33 
and acquiring the power spectrum of the voice signals by 
analyzing the voice signals, and a retrieving unit 42 for 

15 retrieving the control information corresponded to this 
power spectrum from within the storage unit 35. 

The ANALYZING UNIT 41 obtains, as shown in, e.g., 
FIG. 3, the power spectrum of the sound (voice signal) 
to be analyzed, i . e . , a sound pressure level per frequency . 

20 This power spectrum may be what is acquired at a certain 
moment of the analysis target sound and also what 
fluctuates within a predetermined period of time. 

The storage unit 35 is stored with the power spectrums 
of voices in a variety of conditions such as in a train, 

25 a library, a pub (or bar) etc that are likewise obtained 
beforehand by the ANALYZING UNIT 41, and with pieces of 
control information in a way that maps them with each other . 
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FIG. 4 is an explanatory diagram showing a table 
showing the power spectrums and the control information. 
As shown in FIG. 4, a power spectrum field 4a is stored 
with numerical values of the power spectrums under the 
5 respective conditions. An image filed 4b, a music field 
4c, a vibration field 4d and a type field 4e are stored 
with pieces of control information corresponding to the 
power spectrums. The fields, 4b, 4c and 4d are stored 
with an image file, a music file and a vibration file. 

10 Further, the field 4e is stored with a control type. The 
control type indicates, when the power spectrum matches , 
which field the data to be used are stored in. 

The retrieving unit 42 retrieves out, from within 
_ the storage unit 35 , the control information corresponding 

15 to the matched power spectrum among the power spectrums 
obtained by the ANALYZING UNIT 41. 

In this case, the retrieving unit 42 judges whether 
the power spectrum matches or not in a way that, as written 
in, e.g., Handbook of Electronic Information 

20 Communications (published by Ohm Co. , Ltd.) , obtains a 
spectral distance scale of the power spectrum, and judges 
that the power spectrum matches when the distance is equal 
to or smaller than a predetermined threshold value and 
that the power spectrum does not match when larger than 

25 the threshold value . Further , a probability model of each 
power spectrum is obtained, and it is judged whether the 
respective probability models come to have an approximate 
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relationship. Note that other matching methods may be 
utilized without being limited to the method described 
above . 

It is also to be noted that the display unit 34 and 
5 the call notifying UNIT 37 are categorized as an output 
unit for displaying he image, reproducing the music and 
giving a notice by vibrations under the control of the 
control UNIT 33. 

§3 . Control Procedure 
10 FIG. 5 is an explanatory diagram showing a control 

procedure of displaying an image corresponding to a voice 
in the embodiment 1 . 

When telephoning a callee as the other speaker by 
an operation of a caller himself or herself, or if a talk 
15 starts in response to calling from the other speaker, the 
voice codec 38 of the mobile phone 3 obtains the voice 
signal from the other speaker (step 1 which will 
hereinafter be abbreviated to SI) . 

Next, the ANALYZING UNIT 41 of the mobile phone 3 
20 acquires a power spectrum by analyzing the voice obtained 
in SI (S2) . 

Subsequently, the retrieving unit 42 retrieves the 
storage unit 35 in order to compare the existing power 
spectrums stored therein with the power spectrum obtained 
25 in S2 (S3) . 

The retrieving unit 42 judges whether or not the 
obtained power spectrum matches with one of the existing 
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power spectrums (S4) . If none of these power spectrums 
are matched, the retrieving unit 42 terminates the process 
and, whereas if matched, acquires the control information 
corresponding to the matched power spectrum (S5) . 
5 Then, in the case of obtaining the control 

information, the control UNIT 33 controls, based on the 
same control information, the display unit 34 or the call 
notifying UNIT 37 so as to display an image and reproduce 
a piece of music or give a notice by vibrations (S6) . FIG. 
10 1 shows an example where the other speaker exists in a 
library. 

Thus, the related image can be displayed 
corresponding to the voice (ambient sound) , and it is 
therefore possible to, when talking outdoors where there 
15 is, for example, heavy traffic, display a related image 
expressing a high traffic density and indicating that it 
is hard to talk due to the noisy ambient sounds as 
illustrated in FIG. 6 . 

It is also feasible to display where the other speaker 
20 exists , whether in a school , a library , a park , a department 
store, a tearoom etc, and the state of the other speaker 
can be thus easily grasped. 

Moreover, it is possible to actualize such a scheme 
of emitting, when arriving at the school, an alarm sound 
25 and giving a notice of switching off a power supply. 
■<<Modified Example 1>> 

FIG. 7 shows an example of utilizing a computer such 
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as the PDA etc byway of a modified example of the embodiment 
1. 

A computer 70 has, as shown in FIG. 7, a main body 
71 incorporating an arithmetic processing unit 72 
5 constructed of a CPU (Central Processing Unit) and a main 
memory, a storage unit (hard disk) 73 stored with software 
for arithmetic processing, an I/O port 74 as an 
input/output unit for the data thereof , and a communication 
control unit (CCU) 75 such as a modem, a TA (Terminal 
10 Adapter) , network card etc each connecting to a network 
and controlling the communications with other computers . 

The storage unit (control information storage unit) 
73 is installed with an operating system (OS) and 
application software (a control program and so on) . The 
15 storage unit 73 is provided inside with a table that shows 
corresponding to between power spectrums and pieces of 
control information in a variety of conditions. 

Input devices such as a keyboard, a microphone etc 
and output devices such as a display, a loudspeaker etc, 
20 are connected to the I/O port 74. 

The arithmetic-processing unit 72 actualizes 
functions of a sound input unit, an analyzing unit, a 
retrieving unit, a control unit etc through processing 
based on information given from peripheral devices and 
25 the application software. 

Note that the functions of the units described above 
are the same as those in the embodiment 1 discussed above, 
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and hence their repetitive explanations are omitted. 

The sound input unit of the computer 70, based on 
the control program, as shown in FIG. 5, obtains the voice 
signals from the other speaker (SI) . 
5 Next, the analyzing unit of the computer 70 analyzes 

the voice obtained in SI and acquires a spectrum (S2) . 

Subsequently, the retrieving unit retrieves the 
storage unit 73 in order to compare the existing power 
spectrums stored therein with the power spectrum obtained 
.10 in S2 (S3) . 

The retrieving unit judges whether or not the 
obtained power spectrum matches with one of the existing 
power spectrums (S4) . If none of these power spectrums 
are matched, the retrieving unit terminates the process 
15 and, whereas if matched, acquires the control information 
corresponding to the matched power spectrum (S5) . 

Then, when obtaining the control information, the 
image is displayed on the display unit or the music is 
reproduced from the loudspeaker on the basis of the control 
20 information under the control of the control unit (S6) . 

Thus, the general-purpose computer executed the 
control program, thereby obtaining the same effect as that 
in the embodiment 1 . 

«Modified Example 2>> 
25 FIG. 8 shows an example of providing a unit for 

specifying an ambient sound . Note that a modified example 
2 has substantially the same architecture as the embodiment 
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1 illustrated in FIG. 1 has, except that the specifying 
unit 43 is used. 

The specifying unit 43 is stored with the power 
spectrums of the voices uttered towards a receiver, and 
5 specifies, as a power spectrum of the ambient sound, a 
sound element that is not matched with the power spectrum 
of the voice uttered by the speaker toward the receiver 
among the power spectrums of the voices received by the 
sound input unit. 

10 Then, a control signal corresponding to this 

specif ied power spectrum of the ambient sound is retrieved, 
and the control is executed based on the control signal. 

Processing steps in the modified example 2 will be 
explained referring to FIG. 5. To start with, when. 

15 telephoning a callee as the other speaker by an operation 
of a caller, or if a talk starts in response to calling 
from the other speaker, the voice codec 38 of the mobile 
phone 3 obtains the voice signal from a receiver (an input 
unit 40) (step 1 which will hereinafter be abbreviated to 

20 SI) . Namely, according to the modified example 2, the 
processing target is not the voice of the other speaker 
but the voice (including the ambient sound) of the user 
of the mobile phone 3 . 

Next, the ANALYZING UNIT 41 of the mobile phone 3 

25 acquires a power spectrum of the voice (including the 
ambient sound) inputted to the receiver by analyzing the 
voice obtained in SI and also a power spectrum of the voice 
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of the speaker by retrieving the storage unit 35, and 
specifies, as an ambient sound power spectrum, a sound 
element unmatched with the power spectrum of the speaker 
in the obtained power spectrum of the inputted voice (S2 ) . 
5 Subsequently, the retrieving unit 42 retrieves the 

storage unit 35 in order to compare the existing power 
spectrums stored therein with the ambient sound power 
spectrum obtained in S2 (S3) . 

The retrieving unit 42 judges whether or not the 

10 ambient sound power spectrum matches with one of the 
existing power spectrums (S4) . If none of these power 
spectrums are matched, the retrieving unit 42 terminates 
the process and, whereas if matched, acquires the control 
information corresponding to the matched power spectrum 

15 (S5) . 

Then, in the case of obtaining the control 
information, the control UNIT 33 controls, based on the 
same control information, the display unit 34 or the call 
notifying UNIT 37 so as to display an image and reproduce 
20 a piece of music or give a notice by vibrations (S6) . 

The control is thus conducted with respect to only 
the ambient sound , and the ambient condition can be grasped 
at a high accuracy. 

Note that the specifying unit 43 judges, if the 
25 speaker's voice power spectrum is not contained in the 
speech, it to be non-speaking period fur the duration of 
containing the power spectrum of the speaker's voice 
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uttered toward the receiver among the voice power spectrums 
received by the sound input unit, and may specify, as an 
ambient sound, the voice received by the sound input unit 
during the non-speaking period. 
5 In the case of thus detecting from the ambient sound 

that the speech is conducted outdoors where, e.g. , there 
is the heavy traffic, the system is capable of notifying 
the user of the device (the mobile phone) that it is 
difficult to have a talk due to the noisy ambient sound. 

10 Further, the system can be utilized for detecting 

from the ambient sound that the user of the device exists 
in a place that should switch off the power supply of the 
device as in a school , a library , a hospital and an airplane , 
and in a place that should retrain an output level of the 

15 calling sound when the call arrives, and for prompting 
the user to perform the device settings suited to where 
the user exists in a way that outputs an alarm sound and 
gives a notice by vibrations. 

Note that the modified example given above has 

20 exemplified how the processing steps are executed during 
the speaking period, however, the above processing steps 
may be executed for a processing target ambient sound 
inputted during the non-speaking period as in the standby 
status , or during the non-using period of the device (that 

25 is the mobile phone in this example) including the control 
system of the present invention. With this scheme, the 
user can be prompted to the device settings suited to where 
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the user exists. 

«Modified Example 3>> 

In the embodiment 1 shown in FIG . 1 , the voice codec 
(the sound input unit) 38 may receive, as an input for 
5 grasping the condition, the voice inputted from the input 
unit 40, analyze the power spectrum, retrieve out the 
control information corresponding to the same power 
spectrum, and perform the control based on the sound 
ambient to the user himself or herself. 

10 FIG . 9 shows an example of simultaneously displaying 
an image 81 representing what situation the other speaker 
is and an image 82 representing what situation the user 
himself or herself is in this case. 
Processing steps in a modified example 3 will be 

15 explained referring to FIG. 5. To begin with, when 

telephoning a callee as the other speaker by an operation 
of a caller, or if a talk starts in response to calling 
from the other speaker, the voice codec 38 of the mobile 
phone 3 obtains the voice signal from a receiver (an input 

20 unit 40) or from the other speaker (SI) . Namely, according 
to the modified example 3, the processing targets are the 
voice of the other speaker and the voice (including the 
ambient sound) of the user of the mobile phone 3. 

Next, the ANALYZING UNIT 41 of the mobile phone 3 

25 acquires a power spectrum of the voice (including the 
ambient sound) inputted to the receiver by analyzing the 
voice obtained in Si and also a power spectrum of the voice 
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of the speaker by retrieving the storage unit 35, and 
specifies, as an ambient sound power spectrum, a sound 
element unmatched with the power spectrum of the speaker 
in the obtained power spectrum of the inputted voice (S2 ) . 
5 Subsequently, the retrieving unit 42 retrieves the 

storage unit 35 in order to compare the existing power 
spectrums stored therein with the ambient sound power 
spectrum obtained in S2 (S3) . 

The retrieving unit 42 judges whether or not the 

10 ambient sound power spectrum matches with one of the 
existing power spectrums (S4) . If none of these power 
spectrums are matched, the retrieving unit 42 terminates 
the process and, whereas if matched, acquires the control 
information corresponding the matched power spectrum 

15 (S5) . 

Then, in the case of obtaining the control 
information, the control UNIT 33 controls, based on the 
same control information, the display unit 34 or the call 
notifying UNIT 37 so as to display an image and reproduce 

20 a piece of music or give a notice by vibrations (S6) . 

Note that the control UNIT 33 judges whether or not 
a speech button (for starting a speech) of the key operation 
unit 36 is pressed, thereby judging whether it is the 
speaking period or the non-speaking period, and there may 

25 be displayed the situation of the user himself or herself 
for the non-speaking period , i.e., before dialing and the 
situation of the other speaker during the speaking period . 
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This scheme enables the user to visually check whether 
the conditions of the noises ambient to the user are suited 
to the talk before starting the speech. 

In this modified example 3, as a matter of course, 
5 the recognition of the situation (environment) of the other 
speaker can be- actualized simply by changing a part of 
the processing steps explained in the modified example 
1, and the recognition of the condition of the noises 
ambient to the user himself or herself can be actualized 
10 simply by changing a part of the processing steps explained 
in the modified example 2. 

<Embodiment 2> 

An architecture of an embodiment 2 is substantially 
the same as the embodiment 1 , except that there is provided 
15 a detection unit for detecting pieces of auxiliary 

information about a time, a position, brightness and so 
on. Note that the same components are marked with the 
same numerals, and the repetitive explanations are 
omitted. 

20 FIG. 10 is a schematic diagram of the mobile phone 

3 in the embodiment 2 . 

The detection unit 44 detects and outputs the 

auxiliary information about the time, the position, the 

brightness etc to the control UNIT 3 . 
25 Further , the storage unit 35 is stored with the power 

spectrums and the pieces of auxiliary information in a 

way that makes them corresponding to each other. 
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Then, the retrieving unit 42 compares the power 
spectrum of the voice received by the sound input unit 
and the auxiliary information with the power spectrums 
and the auxiliary information stored in the storage unit 
5 35, and retrieves out control information corresponding 
to the matched power spectrum and auxiliary information. 

The control UNIT 33 controls the display unit 34 
or the call notifying UNIT 37 on the basis of the control 
information . 

10 Processing steps in the embodiment 2 will be 

described referring to FIG. 5. To begin with, when 
telephoning a callee as the other speaker by an operation 
of a caller, or if a talk starts in response to calling 
from the other speaker, the voice codec 38 of the mobile 

15 phone 3 obtains the voice signal from the other speaker 
(step 1 which will hereinafter be abbreviated to SI) . 

Next, the ANALYZING UNIT 41 of the mobile phone 3 
acguires a power spectrum by analyzing the voice obtained 
in SI (S2) . 

20 Subsequently, the retrieving unit 42 retrieves out 

the power spectrum obtained in S2 and the auxiliary 
information detected by the detection unit 44 from within 
the storage unit 35, and compares them with the power 
spectrums and pieces of auxiliary information stored 

25 therein (S3) . 

The retrieving unit 42 judges whether or not the 
power spectrum and the auxiliary information match with 
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those stored therein (S4) . If none of these power 
spectrurns and these pieces of auxiliary information are 
matched, the retrieving unit 42 terminates the process 
and, whereas if matched, acquires the control information 
5 corresponding to thereto (S5) . 

Then, in the case of obtaining the control 
information, the control UNIT 33 controls, based on the 
same control information, the display unit 34 or the call 
notifying UNIT 37 so as to display an image and reproduce 

10 a piece of music or give a notice by vibrations (S6) . 

As described above, according to the embodiment 2, 
the situation is judged from the power spectrum and the 
auxiliary information in combination and can be therefore 
grasped at a high accuracy. 

15 For example, as for a voice even at the same 

intersection, the traffic density changes depending on 
the time such as early in the morning, daytime, midnight 
etc, and hence matching between the time and the power 
spectrum is executed. 

20 Further, the brightness is used as the auxiliary 

information, and it is therefore possible to distinguish 
between indoor and outdoor, and precisely distinguish 
between a tearoom and a park even in the case of the power 
spectrum of the voice having the same tone . 

25 Moreover, even when obtaining the power spectrum 

in an indoor areas as quiet as in, e.g. , the school, the 
library etc , the condition thereof can be precisely j udged 
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from the positional information thereof by retrieving 
facilities vicinal to that position by using the positional 
information as the auxiliary information. 
«Modified Example>> 
5 Note that the function of the embodiment 2 discussed 

above may be embodied by the computer such as the PDA etc 
as in the modified example 1 of the embodiment 1 . 

Although only a few embodiments of the present 
invention have been described in detail above, those 

10 skilled in the art will readily appreciate that many 
modifications are possible in the preferred embodiments 
without departing from the novel teachings and advantages 
of this invention. Accordingly, all such modifications 
are intended to be included within the scope of the present 

15 invention as defined by the following claims . 



